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ABSTRACT 

Providing quality of service in random access multi-hop wireless 
networks requires support from both medium access and packet 
scheduling algorithms. However, due to the distributed nature of ad 
hoc networks, nodes may not be able to determine the next packet 
that would be transmitted in a (hypothetical) centralized and ideal 
dynamic priority scheduler. In this paper, we develop two mech- 
anisms for QoS communication in multi-hop wireless networks. 
First, we devise distributed priority scheduling, a technique that 
piggybacks the priority tag of a node's head-of-line packet onto 
handshake and data packets; e.g., RTS/DATA packets in 
IEEE 802.1 1. By monitoring transmitted packets, each node main- 
tains a scheduling table which is used to assess the node's priority 
level relative to other nodes. We then incorporate this scheduling 
table into existing IEEE 802.11 priority back-off schemes to ap- 
proximate the idealized schedule. Second, we observe that conges- 
tion, link errors, and the random nature of medium access prohibit 
an exact realization of the ideal schedule. Consequently, we devise 
a scheduling scheme termed multi-hop coordination so that down- 
stream nodes can increase a packet's relative priority to make up 
for excessive delays incurred upstream. We next develop a simple 
analytical model to quantitatively explore these two mechanisms. 
In the former case, we study the impact of the probability of over- 
hearing another packet's priority index on the scheme's ability to 
achieve the ideal schedule. In the latter case, we explore the role 
of multi-hop coordination in increasing the probability that a packet 
satisfies its end-to-end QoS target. Finally, we perform a set of ns-2 
simulations to study the scheme's performance under more realistic 
conditions. 

1. INTRODUCTION 

Supporting real-time flows with delay and throughput constraints is 
an important challenge for future wireless networks. Indeed, pro- 
viding differentiated quality-of-service levels increases a system's 
total utility when applications have diverse performance require- 
ments, e.g., some preferring low delay, others high throughput, and 
others merely best effort service [17]. Consequently, both medium 
access control and network-layer scheduling algorithms must select 



and transmit packets in accordance with their QoS requirements. 

In wireless networks with base stations, the base station acts as 
a centralization point for arbitration of such QoS demands. For 
example, suppose the goal is to support delay-sensitive traffic us- 
ing the Earliest Deadline First (EDF) service discipline. In this 
case, each packet has a priority index given by its arrival time plus 
its delay bound. Consequently, the base station can simply select 
the packet with the smallest priority index for transmission on the 
down-link, subject to its channel being sufficiently error-free. In 
this way, an "ideal" EDF schedule could be approximated to the 
largest extent possible allowed by the error-prone wireless link. 

However, in networks without base stations, there is no central- 
ized controller which can assess the relative priorities of packets 
contending for the medium. Consequently, the node actually pos- 
sessing the highest priority packet is unaware that this is the case; 
nor are other nodes with lower priority packets aware that they 
should defer access. Moreover, in multi-hop (or ad hoc) networks 
in which packets are forwarded across multiple broadcast regions, 
it becomes increasingly challenging to satisfy a flow's end-to-end 
QoS target. 

In this paper, we introduce a new framework for dynamic priority 
packet transmission in multi-hop wireless networks. Our key in- 
sight is that the broadcast nature of the wireless medium together 
with the store-and-forward nature of multi-hop networks provide 
opportunities to communicate and coordinate priority information 
among nodes. Our goal is to exploit these system attributes and 
develop integrated medium access and scheduling algorithms that 
satisfy a high fraction of QoS targets using fully distributed mech- 
anisms. 

Our contribution is two fold. First, within a broadcast region, we 
devise a mechanism termed distributed priority scheduling in which 
each node locally constructs a scheduling table based on overheard 
information, and incorporates its estimate of its relative priority into 
medium access control. In particular, each packet has an associ- 
ated priority index which can be computed with purely local infor- 
mation (e.g., a deadline). When a node issues a Request To Send 
(RTS) in IEEE 802.11 [7, 15], it piggybacks the priority index of 
its current packet. Nodes that overhear this RTS will insert an entry 
into a local scheduling table. If the node is granted a CTS, it in- 
cludes the priority index of its head-of-line (higher priority) packet 
in the DATA packet, which is also inserted in the local table by 
overhearing nodes. Each node can then assess the priority of its 
own head-of-line packet in relation to its (necessarily partial) list 
of other head-of-line packets. We show that this information can 



be exploited via a minor modification of existing 802. 1 1 prioritized 
back-off schemes to closely approximate a "global" dynamic prior- 
ity schedule in a distributed way. 

In practice, all nodes are not assured to hear all RTSs due to a num- 
ber of factors including node mobility, location dependent errors, 
partially overlapping broadcast regions, and collisions. Thus, each 
node's scheduling table will be incomplete. To address this issue, 
we devise a simple analytical model to explore the relationship be- 
tween the probability, g, that a head-of-line packet is in a node's 
scheduling table and the system's ability to satisfy its QoS tar- 
gets. The model indicates and simulations corroborate that even 
with moderate values of q f the scheme can achieve significant im- 
provements over 802. 1 1 and closely approximate the ideal case of 
q = l (corresponding to all RTSs overheard and perfect scheduling 
tables). For example, in ns-2 simulations with 38 nodes transmit- 
ting and 74% load, we found that with q = 0.60, the scheme reduces 
the mean delay from 2.86 sees (for 802.1 1) to 0.6 sees. 

Our second contribution is coordinated multi-hop scheduling, a 
mechanism for modifying downstream priorities based on a 
packet's upstream service in order to better satisfy end-to-end QoS 
targets across multiple nodes of ad hoc networks. In particular, with 
a distributed random access protocol and bursty traffic arrivals, not 
every packet will satisfy its local QoS target, even if q = 1. We show 
that by recursively computing a packet's priority index based on 
its previous (upstream) index, downstream nodes can help packets 
catch up if they are excessively delayed upstream, whereas packets 
arriving early can have their priority reduced to allow more urgent 
packets to pass through quickly. 

We then describe several multi-node policies within this frame- 
work. For example, we describe delay and rate-based policies in 
which flows can target a maximum delay or minimum service rate 
respectively. To quantify the performance impact of multi-hop co- 
ordination, we extend the aforementioned analytical model to in- 
clude multiple broadcast regions and flows forwarded over multi- 
ple hops. Moreover, we study its performance gains via simulations 
and find for example, that under a simple policy of a single per-hop 
local delay target and 90% load, coordination decreases the average 
delay by 60% as compared to 802.1 1 and by 25% as compared to 
distributed priority scheduling without coordination. 

Thus, together, distributed priority scheduling and multi-hop coor- 
dination provide a framework for distributed medium access con- 
trol and scheduling designed to satisfy end-to-end QoS targets. Our 
contribution is to introduce these mechanisms, develop an analyti- 
cal model to characterize their effect, devise simple policies to il- 
lustrate their application, and perform simulation experiments to 
quantify their performance in more realistic environments. 

The remainder of this paper is organized as follows. In Section 2 
we present distributed priority scheduling. In Section 3 we describe 
multi-hop coordination. Finally, in Section 4 we review related 
work and in Section 5 we conclude. 

2. DISTRIBUTED PRIORITY SCHEDULING 
2.1 Preliminaries 

In this section, we devise a scheme for approximating a dynamic 
priority scheduler within a broadcast region (a region in which all 
nodes are within radio range of all other nodes) controlled by a 
CSMA/CA scheme. Our technique applies to the class of sched- 
ulers in which packets are serviced in increasing order of a priority 



index, where the index can be computed using only flow and node 
information, i.e., state available at the node or carried in the packet, 
and not state of other flows. This class includes Earliest Deadline 
First and Virtual Clock (VC) [21], the two schedulers that we focus 
on throughout this paper. In EDF, a packet arriving at time t and 
having (class) delay bound d has deadline (priority index) t + d. In 
virtual clock, a packet with size L of a flow with service rate r has 
a priority index of L/r plus the maximum of the current time t and 
the priority index of the flow's previous packet. 

Observe that this class of schedulers does not include Weighted Fair 
Queueing [16], as computation of a packet's priority index in WFQ 
requires knowledge of whether or not other flows are backlogged, 
information that we will see is problematic to obtain in a distributed 
environment. 

For a given set of packets in a broadcast region and a given packet 
service discipline such as EDF or VC, an ideal system would ser- 
vice packets exactly in order of their priority indexes. We refer 
to such a hypothetical schedule as the ideal or correct schedule 
and seek to design distributed algorithms to closely approximate 
this service order. Finally, we refer to a node's head-of-line (HOL) 
packet as the packet with the highest priority (lowest index) that is 
queued locally. Thus, each node has a unique HOL packet (if any). 

2,2 A Mechanism for Distributed 
Approximation of Priority Schedules 

As described in the Introduction, a centralized scheduler with 
knowledge of all packet priority indexes can in principle sched- 
ule packets in exact order of the ideal schedule. However, due to 
the distributed nature of ad hoc wireless networks, each node is 
equipped with its own buffer state (local information), and at best 
partial information about other nodes. Thus, it is immediate that 
if the scheduler is distributed, with incomplete system information, 
the ideal schedule cannot be met exactly. 

To better approximate the ideal schedule, we propose to exploit the 
broadcast nature of the medium and piggyback priority indexes of 
the current and HOL packets. The proposed piggyback mechanism 
allows for efficient exchange of information while imposing min- 
imal overhead. Each node then maintains a local scheduling table 
and on hearing newly announced priority indices, adds them to the 
local table. This local table is then adaptively used to control the 
channel access policy used by the node. We emphasize that all poli- 
cies are completely distributed with information exchange relying 
solely on existing broadcasts by each node. Using analytical and 
simulation based studies, we show that the piggybacked informa- 
tion can yield significant gains in the probability of transmitting 
packets in order of the ideal schedule, and corresponding reduc- 
tions in packet delay. Moreover, we show that these gains can be 
achieved while maintaining high levels of throughput. 

Working in the framework of IEEE 802.11, service differentiation 
in the MAC protocol can be obtained by varying the backoff timer 
distribution, the defer time (DIFS), and the size of the packets [1]. 
Assuming that packet lengths cannot be controlled by the MAC 
layer for real-time traffic, we focus our attention on the first two pa- 
rameters and next present our proposed mechanism for distributed 
priority scheduling and adaptive backoff for IEEE 802. 1 1 . 



2.3 Proposed Algorithm 

In this section, we first briefly review the IEEE 802. 1 1 distributed 
coordinated function; for more details, readers are referred to [7]. 
Next, the proposed information exchange mechanism using piggy- 
backed priority tags is presented. Finally, we introduce adaptive 
backoff policies for IEEE 802. 1 1 that exploits this additional infor- 
mation. 



The RTS and CTS packets have information regarding the desti- 
nation node and the length of the data packet to be transmitted. 
Any other node which hears either the RTS or CTS packet can use 
the data packet length information to update its network allocation 
vector (NAV) containing the information of the period for which 
the channel will remain busy. Thus, any hidden node can defer its 
transmission suitably to avoid collision. 



23 .1 IEEE 802 J 1 Distributed Cooordination 
Function 

In IEEE 802.1 1, mere are two common modes of packet transmis- 
sion: a basic access mechanism with a two-way handshake and a 
four-way handshake mechanism with short request packets before 
the actual transmission. In this paper, we focus on the four-way 
handshake depicted in Figure 1. A node which intends to trans- 
mit a packet waits until the channel is sensed idle for a time period 
equal to Distributed InterFrame Spacing (DIFS). If the channel is 
sensed idle for a duration of DEFS, the node generates a random 
backoff interval before transmitting (this is the collision avoidance 
feature of the protocol). In addition, to avoid channel capture, a 
node must wait a random backoff time between two consecutive 
new packet transmissions, even if the medium is sensed idle in the 
DIFS time. 
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Figure 1: IEEE 802.11 four-way handshake. 

A discrete backoff timer is used for reasons of efficiency, and the 
time following an idle DIFS is slotted. A node is allowed to trans- 
mit only at the beginning of each slot time. Further, DCF uses a 
binary exponential backoff scheme. At each packet transmission, 
the backoff timer is chosen uniformly from the range [0, w — 1], 
where w is called the contention window. At the first transmission 
attempt, w is set to CW m i n which is labeled minimum contention 
window. After each unsuccessful transmission, the value of w is 
doubled, upto the maximum value CW maJC = 2 m CW m ; n . 

The backoff timer is decremented as long as the channel is sensed 
idle, and stopped when a transmission is detected on the channel. 
The backoff timer is reactivated when the channel is sensed idle 
again for more than a DIFS amount of time. The node transmits 
when the backoff timer reaches zero. The first transmission is a 
short request to send (RTS) message. When the receiving node 
detects an RTS, it responds after a time period equal to the Short 
InterFrame Spacing (SIFS) with a clear to send (CTS) packet. The 
transmitting node is allowed to transmit its actual data packet only 
if the CTS packet is correctly received. 



23.2 Priority Broadcast 

To distribute information about the current and HOL packets at 
other nodes, we propose to piggyback current packet information 
in the RTS/CTS frames and the HOL packet information in 
DATA/ACK frames (see Figure 2). The piggybacked information 
includes the packet priority tag and source node ID for CTS, and 
only the packet priority tag for RTS frame. Source/destination IDs 
require four bytes in IPv4 and sixteen bytes in IPv6 and priority 
tags can be represented using one byte. If the RTS suffers no colli- 
sions, then all nodes in the broadcast region hear the RTS (node 9 
in Figure 2) and add an entry in their local scheduling table. When 
the receiving node grants a CTS, it also appends the priority in the 
CTS frame. This allows the hidden nodes (node 7 in Figure 2), 
which are unable to hear the RTS, to add an entry in their schedul- 
ing tables upon hearing the CTS. Upon the successful completion 
of the packet transmission, which is marked by the ACK frame, 
each node removes the current packet from their scheduling table. 
If either the CTS is not granted by the receiving node or the ACK 
frame is not received, the current packet information is not removed 
from the scheduling tables. 
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Figure 2: Piggybacking on IEEE 802.11 four-way handshake, 
and the updating of scheduling tables. 

When transmitting the DATA packet, each node also piggybacks its 



HOL packet information, which includes the destination and source 
ID along with its priority tag, a total of nine bytes for IPv4 and 
thirty three bytes for IPv6; this information is also copied in the 
ACK frame to allow hidden terminals to hear the HOL packet in- 
formation. Each node, after hearing the data packet, adds another 
entry in its scheduling table. Thus, if the ACK is not heard, each 
waiting node's scheduling table would grow by two entries; oth- 
erwise it would have one additional entry. Thus, in the event of a 
successful transmission, each overhearing node has the same ad- 
ditional entry in its table. On the other hand, if the transmission 
was not successful, each overhearing node has either one or two 
additional entries in its tables. 

In any case, our design philosophy considers that the common case 
will be for nodes to have incomplete scheduling tables, and our 
goal is to closely approximate the ideal schedule even under more 
adverse and realistic conditions. 

2. 3. 3 Modified Backoff Policies 

Here, we describe how the overheard information in each local 
scheduling table can be mapped to a backoff scheme, thereby using 
partial knowledge of other nodes' HOL packets to closely approx- 
imate the ideal transmission schedule. 

Let n denote the number of nodes in the broadcast region. The 
scheduling table of node j y Sj is a list of three tuples, (si, di, P»), 
where Si is the source node ID, di is the destination node ID and 
P(o e {P mi „ j Pmin + 1,... * Pmax } is the priority index of the 
packet. Thus, 

Sj = {(sijdijP^)) : Si j^di\s i% di 6 {1, . . . ,n}; 1 < % < tj} , 

(1) 

where tj is the size of the scheduling table Sj . If node j is back- 
logged, then its scheduling table consists of an entry with $i = j. 
Without loss of generality, we assume that the scheduling table en- 
tries are sorted such that P(i) < P( 2 > < • • ■ < P(t,)- 

In the context of IEEE 802. 1 1 , a collision resolution policy involves 
selecting a backoff timer distribution. In other words, given the 
scheduling table Sj, the channel access policy computes /(Sj), 
which is the backoff timer distribution. We limit our attention to 
the following class of distributions, 

fi(Sj) = Wi(Sj) + Uniform[0, 2 l g t (Sj) - 1], (2) 

where Uniform [a, 6] represents the discrete uniform distribution 
on the range from a to b. The function gi maps a scheduling table, 
S to a real number greater than 1. The index 0 < / < (m — 1) 
represents the number of retransmission attempts. The constants 
Wi (•) denotes the additional waiting time beyond DIFS, and allows 
for the possibility of contention reduction (explained below). In 
IEEE 802.11, Wt(>) = 0 and #(•) = CW min . Note that only the 
backoff distributions have been changed and the remaining com- 
ponents of collision resolution/avoidance are identical to those of 
in IEEE 802.11. 

Let rj be the rank of node j's packet in its own scheduling table Sj . 
Then the proposed backoff policy, characterized by distributions 
/<(•)> is: 



Unif[0,2'CW rai „-l], 
//(Si) = { aCW rain + Unif[0, 7 CW 
Unif[0,2 Z 7CW min -l], 



min 



Tj ; = 1,1 < m 
-1], r i >l,/ = 0 
rj > 1J > 1 
(3) 



Here #(•) is a two-part function gi(>) = CW m i„ if rank of the 
node rj = 1 else gi(-) = 7CW ra i n if rj > 1. The policy uses a 
combination of contention reduction and collision resolution. The 
contention reduction is achieved by deterministically deferring the 
transmission beyond DIFS for some of the nodes, thereby reducing 
the contention in first aCW m i n time slots. The constant a con- 
trols the extent of contention reduction. If o = 1, then all nodes 
which are not ranked one in their scheduling table do not contend 
for the first CW ro i n slots, thereby reducing the contention in the 
first attempt for top ranked nodes (recall rank is determined from 
the local scheduling table). For q close to one, a = 1 would im- 
ply that the highest rank node will capture the channel successfully 
with high probability in the first attempt. The constant 7 controls 
the total contention in the second attempt for highest rank nodes. 
For small 7, the contention after CW ra i„ increases significantly, 
since all waiting nodes contend. This also means increased colli- 
sions and potential throughput loss. A larger 7 allows for reduced 
probability of collision and provides a better chance of successful 
channel capture; we use 7 = 2 to allow equal contention for all 
nodes after the first CW m i n slots. 

Finally note that the policy is independent of the size of the net- 
work and the number of overheard HOL indexes in the scheduling 
tables. Regardless, the performance of the above policy improves 
when the scheduling table contains a higher fraction of the back- 
logged nodes' HOL indexes: however, below we show that even 
with tables that are quite incomplete, the performance gain of a 
perfect table can be closely approximated. 

2.4 Analytical Model 

In practice, a number of factors preclude nodes from having com- 
plete scheduling tables with an entry for every HOL packet in the 
broadcast region. These factors include node mobility, location de- 
pendent errors, partially overlapping broadcast regions, and colli- 
sions. In this section, we develop a simple analytical model to ex- 
plore the relationship between the completeness of the scheduling 
table and ability to approximate the ideal schedule. Using results 
from [5], we compute the probability of correct scheduling as a 
function of available information in local scheduling tables. With 
the aid of simplifying assumptions, our results provide insights into 
the basic role of information sharing (communicating priority in- 
dexes) in distributed scheduling. 

In [5], an analytical model is developed to compute the 802. 1 1 DCF 
throughput under ideal channel conditions with an assumption that 
each node always has a packet available to transmit. A Markov 
model for each node is obtained in [5], by assuming that probability 
of collision, p, in any slot is independent of transmission history 
of nodes. Note that the assumption of time-invariant p is a good 
approximation for large n and CW min . The Markov model is then 
used to compute r, which is the probability that a node transmits 
in a randomly chosen time slot. The probability r with n mobile 
stations, is given as [5] 



1 + CW min + pCW min 1 (2pY ' 



(4) 



where 771 is the maximum back-off stage and p is the conditional 
collision probability given by 



p=l-(l-r) 



(5) 



Equations (4) and (5) represent a nonlinear system in the two un- 
knowns r and p, which is shown to have a unique solution [5]. 



Here, we generalize Equations (4) and (5) to dynamic priority 
scheduling in which the size of the contention window is a function 
of the priority of the packet. However for simplicity no exponential 
backoff is considered, i.e. m = 0. Let Pk denote the priority index 
of the HOL packet of node k r k = 1, 2, . . . , n. Further consider 
discrete priority indexes, uniformly distributed between P m j n and 
F mM . Based on the proposed policy in Section 2.3, the contention 
window of each node depends on the rank of its HOL packet in its 
local scheduling table. Let [0, W h - 1] and [W, Wi - 1] be the 
contention window for the node with the highest rank and all oth- 
ers, respectively, where W = aCW m i n is the fixed waiting period 
and W h = CW min and Wi = /?CW rain . The probability of trans- 
mission for the node(s) with highest priority packet(s) in slots 1 to 
Why is then given by 



Th = 



1 + Wk' 



(6) 



The same probability will be zero for all other nodes in the afore- 
mentioned slots; however the probability of transmission for all 
nodes for slots greater than W is given by 



Tl — 



1 + Wi-W 



(7) 



Assuming that rih nodes contend in the first window, the condi- 
tional collision probability will be 



p=l-(l-r fc r fc - 1 , 



(8) 



for slots 1 to Why and 



p = 1 - i [n h r h (l - Th)"*- 1 ^ - T t ) n - n » 

+(n - n h )ri(l - *) m — - W 

for slots greater than W. 

With perfect information the number of nodes contending in the 
first window is limited to those having packets with the highest pri- 
ority in their queues. And if there is only one such a node, the 
probability of capturing the channel by the highest priority packet 
will be equal to one. Since the ties are broken at random, the num- 
ber of contending nodes in the first window can be greater than 
one, thereby improving the approximation for Th even for perfect 
information case. 

However, as described above, perfect information on all nodes' 
HOL packets will not be available in practice. Thus, we model the 
imperfect information by assuming that each node has a scheduling 
table entry of the HOL packet of any other node (in the broadcast) 
region with probability q. 

With q < 1, nodes can mistakenly infer that the highest priority 
packet in the entire broadcast region (i.e., the packet that would be 
selected by the ideal scheduler) is queued locally, when in fact it is 
queued at an alternate node. The probability that node i's own HOL 
packet is the highest priority packet in its table (i.e., node i believes 
that it possesses the region's highest priority packet), denoted by 
g/i,is given by 



mu 



qk= Yl p(Pi=t)Y[[p{Pi>i)]. 



(10) 



i=p. 



mm 



Noticing that the priorities of different packets are statistically in- 



dependent, Equation (10) can be further simplified as 



max 



l — p ■^ majc Pmin ~\~ 1 



Pm^ - I + 1 
Pm&x Pmin "I" 1 



in-1 



<? + (!-<?) 



(11) 



Hence, during the primary contention window [0, W], approxi- 
mately qh - n nodes contend for the channel, whereas after that 
all n nodes may take part in contention. 

Denote the probability of successful transmission of the true high- 
est priority packet before any other packet in the broadcast region 
by P{T h ). This probability for the primary contention window can 
be written as 



w h 



Pw h (T h ) = £(1 - Thr^^rhil - Th) qhn ' 1 



(12) 



i=i 



which is the probability of having i idle slot times, followed by 
transmission of highest priority packet only. After W slots the suc- 
cessful transmission of the highest priority packet will be possible 
if all other n — 1 nodes defer. The probability of correct scheduling 
for this case is 

P>w(Tk) n TZ W {[{1 - Th)*» n (l - n)^^' 1 

T h (l-Th) qhn - 1 (l-Tl) {1 - qh)n } 

Finally the general form for P(Th) is given by 

P(Tk) = P <W (T h ) + P >w (T h ) 



(13) 



(14) 



We now present numerical investigations applying the analysis 
above. Figure 3 depicts the probability of correct scheduling vs. 
number of nodes for different values of q. Results are shown for 
Pmin = 1, P m *x = 20, W h = W = 31, W t = 63, and m = 0 
(maximum back-off stage equal to zero). 
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Figure 3: Probability of correct scheduling vs. number of nodes 
for different values of q. 

Observe that as the number of nodes increases, the probability of 
correct scheduling (transmission of the region-wide highest prior- 
ity packet first) decreases, reflecting the fundamental challenge of 
distributed scheduling. Moreover this probability is a function of <j, 



and indeed, a large value of q mitigates the effect of a large num- 
ber of nodes. The curve labeled q = 0 shows the performance of 
the system when nodes independently set their contention windows 
without any knowledge of other packets* priority indexes. This be- 
havior is identical to IEEE 802. 1 1 , and the probability of correct 
scheduling in this case is inversely proportional to the number of 
nodes in the broadcast region. 

On the other hand, with q = 1 all nodes have complete knowledge 
of the priorities of HOL packets in the broadcast region, and hence 
can adjust their contention window respectively. In this case, a 
gain of over 40% in probability of correct scheduling is observed 
for n = 20 compared to q = 0. Note that even with q — 1 the 
probability of correct scheduling is less than 1. The reason for this 
is that since the priorities are chosen to be discrete, the probability 
of two packets having the same priority is non zero. It is clear that 
as the difference between P max and P m \ n increases this probability 
decreases, and hence this line will approach P{Tk) = 1. 

Thus, the model and example illustrate the significant benefits of 
having q > 0, i.e., of communicating priority indexes via piggy- 
backing. Moreover, the results indicate that perfect communication 
of HOL indexes is not required and that moderate values of q have 
a significant impact. Indeed, in the simulation study below, we find 
the effect of non-zero q to be even more pronounced. 

2.5 Simulation Experiments 

Here, we present a set of simulations to explore the performance of 
distributed priority scheduling and the IEEE 802. 1 1 protocol under 
realistic scenarios. The simulator was implemented within the ns-2 
(version 2.1b7a). 

We consider a single broadcast region with an available link ca- 
pacity of 2 Mb/sec with an effective data rate of approximately 1.6 
Mb/sec (results with multiple broadcast regions and flows travers- 
ing multiple hops are presented in Section 3.5). Each node gener- 
ates variable-rate traffic according to the exponential on-off traffic 
model with an on-rate of 78 kb/sec, and equal mean on and off 
times of 500 msec each. The data packet size is set to 1000 bytes. 
All other parameters (including 802.11 physical layer parameters) 
were set to the default values as recommended in [7] (also the de- 
fault values set in ns-2). 

In practice, the value of q is affected by a number of factors de- 
scribed previously. In our simulations, nodes update their schedul- 
ing tables as follows. Upon receiving a piggybacked RTS, a node 
enters the priority index into its local scheduling table with proba- 
bility q, otherwise it ignores the priority information, as would be 
the case if there were link errors, nodes temporarily moving out of 
range, etc. In this way, we incorporate a number of effects in a 
single way and isolate the performance impact of q. 

Since our goal with distributed priority scheduling is to approxi- 
mate an ideal dynamic priority schedule, we chose the performance 
metric for our simulations to be end-to-end delay. Figure 4(a) de- 
picts the mean delay versus the fraction of available information 
about other nodes, q. The number of flows is 38 resulting in a mean 
offered load of 74% (ignoring the overhead of RTS/CTS mecha- 
nism for calculation of the load). Figure 4(a) depicts the average 
values and 95% confidence intervals of end-to-end delay for 100 
independent simulation runs. Note the point corresponding to zero 
available information is the delay under the standard IEEE 802. 1 1 
scheme, as our priority scheme degenerates to this standard when 



the scheduling table is empty. 

We observe that as q increases, distributed priority scheduling re- 
sults in a significantly lower delay than IEEE 802. 1 1 . Also, note 
that even for a moderate fraction of available information (between 
0.6 and 0.8), distributed priority scheduling is able to reduce delay 
from about 2.9 sec to about 0.4 sec, closely approximating the case 
of perfect HOL information distribution and q = 1. The reduc- 
tion in delay is due to the fact that distributed priority scheduling 
achieves a closer approximation to an ideal deadline based schedule 
than 802. 1 1 so that contention is dramatically reduced. This is fur- 
ther illustrated by Figure 4(b) which shows that distributed priority 
scheduling leads to a decrease in the total number of collisions. As 
the number of collisions in the system are reduced, nodes backoff 
less often resulting in lower delays. 
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Figure 4: Performance of distributed priority scheduling for a 
single broadcast region. 

3. MULTI-HOP COORDINATION 
3.1 A Mechanism for Multi-hop Priority 
Scheduling 

In the previous section we showed how distributed priority schedul- 
ing can be used within a broadcast region to approximate the trans- 
mission order of an ideal dynamic priority scheduler. However, 
this transmission order is necessarily imperfect due to factors such 



as link errors, the random-access nature of the medium, and the 
burstiness of the traffic demands. As packets traverse multiple 
hops, these effects can be compounded, and severely limit a flow's 
ability to satisfy its end-to-end QoS targets. 

Our key observation is that downstream nodes can adjust the prior- 
ity level of packets based on their performance upstream. In par- 
ticular, we develop multi-hop coordination as a technique that en- 
ables packets to "catch up" downstream if they endure excessive 
delays upstream, due to events such as collisions, queuing from 
other bursts of traffic, or mobility of intermediate hops. In this way, 
we increase the opportunity for a packet to meet its end-to-end QoS 
target. 

3.2 Definition 

In [6], the FIFO+ scheduling algorithm is defined (for wired net- 
works) as follows. At the first network node, a packet's priority 
index is simply its arrival time. Hence, packets are served in FIFO 
order. However, at downstream node j, an offset of dj — dj-i is 
accumulated into the packet's original priority index, where dj is 
the mean queueing delay at node j and dj-i is the actual delay 
of packet k at the immediately upstream node. Consequently, if a 
packet is late relative to others its priority is increased downstream. 

Here, we utilize this concept of coordination, and building on the 
definition in [9], generalize the technique to multi-hop wireless net- 
works as follows. When a node receives a packet, it also receives 
its priority index in the RTS piggyback. If the node is an interme- 
diate hop and the packet is to be forwarded further, the node will 
compute the new priority index recursively based on the received 
index. Indeed, we will show that simple coordination functions can 
have significant impact on end-to-end performance. 

More precisely, let tj denote the priority index assigned to the 
k th packet of flow-t with size I* at its j th hop. Moreover, let t± 
denote the time when the k th packet of flow i arrives at its first hop. 
Finally, let £* fJ - denote the increment of the priority index of the k tk 

packet of flow i at its j th hop. We consider the class of coordinated 
multi-hop schedulers such that the priority index can be expressed 
as 

L 3 > 1 

where 6i tj is a non-negative function of i, j, f J , 

With priority recursively expressed in this form, the index of each 
packet at a downstream node depends on its priority index at up- 
stream nodes, so that all nodes in the ad hoc network cooperate to 
provide the end-to-end service. For example, if a packet violates 
a local deadline at an upstream node, downstream nodes will in- 
crease the packet's priority thereby increasing the likelihood that 
the packet will meet its end-to-end delay bound. Similarly, if a 
packet arrives "early" due to a lack of contention upstream, down- 
stream nodes will reduce the priority of the packet. 

3.3 Index Assignment Schemes 

Priority indexes can be assigned according to whether the flow or 
class targets an end-to-end delay or rate. In the former case, differ- 
ent per-node allocation schemes can simplify coordination as de- 
scribed below. 



3. 3. 1 Deadline Targets 

K Si j represents a delay parameter of the k th packet of flow i at its 
j hop, then the nodes coordinate to attempt to meet the end-to- 
end delay target J2j 3 t0 me maximal extent possible under the 
network load and channel conditions. For such deadline targets, we 
consider three index assignment schemes. 

Time To Live (TTL) Allocation: In this scheme, a packet inserts its 
desired end-to-end delay bound as its priority index. Each node 
decrements the TTL by the time taken to access the channel and 
transmit the packet. In particular, the priority indexes are given by 
8*1 = TTLi and Sfj = 0 for j > 1. We refer to this scheme as 
the TTL scheme since TTLi can be interpreted as the time duration 
for each packet of flow t to be allowed to stay in network. We 
make the following observations. First, flows can be differentiated 
by assigning different TTL's as flows with smaller TTL's will 
obtain better service than flows with larger TTL's. Second, this 
scheme gives preference to packets that have traveled several hops 
and implicitly assumes that the priority of a packet increases with 
the time it has spent in the network. 

Fixed Per-Node Allocation: In this scheme, each node m is as- 
signed a constant G m , and 6*$ = Gm if node m is the j th hop 
of the packet. Since the G m *s are independent of packets, dif- 
ferent nodes may have different constants, but all packets that are 
transmitted by the same node have the same increment of prior- 
ity indexes at that node. While the scheme could be generalized 
to support different classes, we observe that while the technique is 
quite simple to implement, a fixed per-node allocation scheme does 
discriminate against packets with long paths. 

Uniform Delay Budget (UDB) Allocation: In this scheme, for a 
flow i with an end-to-end delay target D, the increments of the 
priority index of the flow's packets are assigned as Sij = ~ for 
j = 1, 2, • • • , K, where K is the length of the flow's path and 
can be obtained from routing table under source routing (e.g., as 
in Dynamic Source Routing [8]). Thus, whereas the TTL scheme 
allocates the entire delay budget to the first node (but then uses 
coordination to ensure that packets have sufficient priority down- 
stream), the UDB scheme allocates the delay budget uniformly 
among nodes. 

3.3.2 Rate Targets 

In addition to targeting maximum delays, flows can target mini- 
mum service rates. In particular, if 6*j is a function of and r,*, 
where is the size of the k th packet of flow i and n is the targeted 
bandwidth for flow i, then a coordinated virtual clock scheduler can 
be attained by assigning indexes as: 1 

\ tfj-i + J > 1 

We observe that coordinated virtual clock attempts to allocate dif- 
ferent rates to flows on an end-to-end basis, just as virtual clock 
[21] allocates rates on a per-hop basis. Note however, that despite 
the targets of minimum rates, this scheduling algorithm is not tar- 
geting max-min fairness for reasons described in Section 4. 



We note that such allocation is similar to core-stateless jitter vir- 
tual clock [18] which uses a related index assignment scheme to 
achieve scalability. 



3.4 Analytical Model 

In this section, we devise a simple analytical model of multi-hop 
coordination and compare the probability of meeting an end-to-end 
delay bound over a multi-hop path with and without coordination. 

Our aim is to characterize transmission and medium access delays, 
and hence we neglect queuing delay by assuming that there is al- 
ways one and only one packet in each node's queue. With this 
assumption, the delay that each packet suffers at any node is com- 
pletely determined by the time required to successfully reserve the 
channel in the presence of competing nodes. The total delay con- 
sists of time slots which were idle, slots with collisions and slots 
with successful packet transmission by other nodes. Let 5 denote 
a slot time, and assume that a successful transmission and a col- 
lision need respectively T a and T c slots; then the delay D can be 
expressed as 

D = {m+T a n a + T c -n c )<5, 

where n;, n a > and n c represent the number of idle slots, slots used 
for successful transmissions and slots with collisions, respectively. 
Assuming that the probability of transmission is high, and that 
T a T c and T a » 1, then the delay can be approximated by 
D « T a • n s • 6. In other words, in a single broadcast region 
the delay that a packet suffers before its successful transmission 
is approximately equal to the number of successful transmissions 
of other packets during its defer interval. Hence, to compute the 
probability that a given packet meets its single-hop delay bound, it 
suffices to find the distribution of the number of successful trans- 
missions prior to the aforementioned packet. 

To simplify the analysis, we consider only the case with high q. 
This assumption implies that with high probability, the highest pri- 
ority node will capture the channel in the first contention window. 
Furthermore, since the priorities are time based, we assume that the 
probability that two packets have exactly the same priority tag is 
negligible. Combined with the above two assumptions, it immedi- 
ately follows that if a packet has the highest priority in a broadcast 
region, it will capture the channel in the first transmission attempt. 
Then the probability of capturing the channel in any given con- 
tention window is equal to the probability that a node is ranked one 
for a given priority tag. For delay priority indexes, the priority tags 
can be set based on TTL. If we assume that TTLs are distributed 
uniformly from 0 to Td (the end-to-end delay), then the probability 
that a node has rank r among n nodes in a broadcast region is 



P( rank = r\TTL) 



-(#)[ 



Td-TTLy~ T I TTL 
Td \ [ Td m 



1 r-l 



(17) 

Since a node can transmit if and only if it is ranked 1 (based on the 
assumptions above), it follows that the probability of delay equal to 
kT a S slots for node 1 with arrival TTL as TTL 0 is 

(fc-2) 

P(kTJ\TTL 0 ) = n (1 - P(n = 1|T0) P(n = 1|T 2 ) 

2=0 

(18) 

where 



Ti = TTL 0 - zST a and T 2 = TTL 0 - (k - l)ST a . 

Using the above delay distribution, the probability of meeting dead- 
lines can be computed for multi-hop networks with arbitrary con- 
figuration. For illustration, we present the results for a two-hop 
flow with an end-to-end delay target of Td\ Coordinated multi-hop 
scheduling, UDB without coordination and IEEE 802.11 are an- 
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Figure 5: Probability of satisfying end-to-end delay target un- 
der different priority schemes . 



alyzed. For the sake of simplicity, we assume that the number 
of competing nodes per hop is fixed to be n. Then the probabil- 
ity of meeting the end-to-end deadline for coordinated multi-hop 
scheduling, Ilcoord is given by 

K-l K-k 

Ilcooni = P{KT a 6\T d )P(lT a 6\T d - kT a 5), (19) 

*=i i=i 

where K = Lf?J- For UDB with no coordination (under the as- 
sumption that a packet is dropped if it fails to meet its local deadline 
of Td/2), the probability of meeting the deadline Iluncoord is given 
by 

[K/2J min(K-fc,[K/2J) 

nuncooni= £ ]T P{kT s 6\T d )P(lT a 6\T d - kT s 5). 

k=l 2=1 

(20) 

It follows immediately from (19) and (20) that Ilcooni > Iluncoorf. 
Finally, for IEEE 802. 1 1 (which has no coordination), the proba- 
bility of meeting the deadlines is given by 



K-l K-k-l 
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n-2 



m + fc-1 



(21) 



In Figure 5, sample numerical results are shown for T d = 20 msec 
and Td = 16 msec, with T a = 2 msec. From Figure 5, it is clear 
that coordination can significantly improve the probability of meet- 
ing end-to-end deadlines. However, we also note that under heav- 
ier loads, depicted by an increased number of nodes per hop, all 
schemes are degraded significantly. For example for the smaller 
deadline of T d = 16 msec, IEEE 802.11 is superior to coordina- 
tion with a heavy load corresponding to more than 1 1 nodes. In 
this case, the delay target of 16 msec is unrealistic in the current 
load, and many packets are dropped. A higher delay target would 
be required to efficiently coordinate priorities in this regime. 

3.5 Simulation Experiments 

Here, we experimentally study the performance impact of inter- 
node coordination by comparing the coordinated multi-hop schedul- 
ing with uncoordinated scheduling as well as unmodified IEEE 
802. 1 1 . We consider a scenario extending that of Section 2.5 to the 




Figure 6: Simulation topology 



4. RELATED WORK 

In wireless networks with base stations, recent results in schedul- 
ing have shown how to best achieve fairness and weighted fairness 
in the presence of link errors, e.g., [4, 10, 14]. As described in the 
Introduction, new issues arise in the case of ad hoc networks with- 
out base stations. For example, how to achieve fairness accounting 
for the distributed nature of the nodes that contend for the same 
medium, the limits of information exchange between the nodes, 
the fact that packets of a multi-hop flow contend with each other in 
successive hops, and the need for spatial re-use are topics of intense 
recent study and progress [3, 11, 12, 13, 19, 20]. 



topology depicted in Figure 6. We consider n exponential on-off 
traffic flows that traverse at least 2 hops from source Sk to destina- 
tion Dfc, k = 1, 2, • • • , n. We use the UDB (uniform delay budget) 
scheme with an end-to-end delay target of 240 msec for each flow. 
We use the average end-to-end delay as our performance metric and 
explore the variation in mean delay with varying offered load. To 
compute the offered load with multiple overlapping broadcast re- 
gions, we calculate the normalized average rates of all contending 
traffic flows in a single broadcast domain. 

We also note that while nodes remain in a fixed position throughout 
the simulation, we use an ad-hoc routing protocol since the routes 
are not setup at start time. For our simulations we use the Dynamic 
Source Routing (DSR) protocol [8]. 
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Figure 7: Simulated delay performance of multi-hop coordina- 
tion. 

The simulation results presented in Figure 7 depict the end-to-end 
delay performance for the three schemes. We make two observa- 
tions regarding this figure. First, when the traffic load is above 
80%, the coordinated service discipline and the uncoordinated ser- 
vice discipline always outperform the IEEE 802.1 1 DCF MAC pro- 
tocol. This is a consequence of using distributed priority scheduling 
within each broadcast region. Thus the prioritized medium access 
reduces the packet collision and avoids repeated back-off intervals. 

Second, notice that for very high traffic load (90%), the coordi- 
nated scheme outperforms uncoordinated by more than 50%. This 
is due to the fact that the coordinated multi-hop scheduling explic- 
itly targets satisfaction of a flow's end-to-end delay target, yielding 
opportunities to mitigate the effects of poor service received up- 
stream. 



In contrast, our goal of achieving delay or rate QoS targets can 
yield significantly different schedules than those to achieve fairness 
or even weighted fairness. For example, for satisfying delay con- 
straints, EDF is easily shown to outperform WFQ. Furthermore, 
in our problem formulation, if a flow endures location dependent 
errors, no attempt is made to increase service later for the sake 
of achieving fairness. Indeed increasing service to such a "lag- 
ging flow" could be wasteful if the packets' deadlines have passed. 
Regardless, our use of multi-hop coordination would increase a 
packet's priority downstream if it is delayed upstream (for whatever 
reason), yet the goal is to satisfy the delay or rate constraint rather 
than to achieve system wide fairness. 2 Regardless, techniques de- 
veloped for fairness could also be incorporated into our scheme. 
For example, the ideal schedule could be modified to satisfy QoS 
targets subject to limits on unfairness or a minimum level of spatial 
reuse. 

The coordination mechanism has been studied previously to im- 
prove multi-node performance properties [2, 6, 9]. For example 
coordinated EDF was studied in [2, 9] as a mechanism for minimiz- 
ing end-to-end delays in networks of work-conserving schedulers. 
Likewise, FIFO+ was proposed in [6] as an alternative to both FIFO 
and fair queueing for delay-sensitive traffic: in FIFO+, downstream 
nodes adjust a packet's priority index based in its upstream queue- 
ing delay. In our work, we generalize the technique for application 
to ad hoc networks, consider both delay- and rate-based coordina- 
tion, and integrate coordination with MAC-layer mechanisms. 

In [3], a distributed scheduling algorithm was proposed to approx- 
imate first come first serve in ad hoc networks, also using piggy- 
backed information regarding the HOL packets. Our results are 
more general as we consider non-perfect information exchange (the 
delay and throughput analysis in [3] implicitly assumes perfect in- 
formation about the other nodes' packets, equivalent to the case 
of q = 1), a general class of dynamic priority schedulers, the 
medium access algorithm, and multi-hop scenarios. 

In [1], the authors propose modifications to the IEEE 802.11 pro- 
tocol to achieve performance differentiation. In particular, the au- 
thors explore a number of differentiation mechanisms and conclude 
that the most superior scheme is to use a DIFS-based approach in 
which each class has a different value of DIFS: since stations must 
wait at least DIFS before attempting to access the medium, flows 
in classes with the smallest value of DIFS receive the best perfor- 
mance. Meanwhile, back-off schemes are left unmodified to retain 
the desirable stability properties of 802. 1 1 . In our work, our goal is 
to satisfy a dynamic priority scheduler rather than a static priority 



2 Observe that virtual clock (a scheduler that we also use as an ideal 
baseline) possesses the isolation property which, similar to WFQ, 
can be used to provide minimum service rates. However, unlike 
WFQ, virtual clock does not assure max- mi n fairness. 



schedule. Consequently, nodes use distributed priority scheduling 
to assess their relative priority before adjusting their value of DIFS. 
Regardless, techniques and lessons learned in [1] are also applica- 
ble in our scheme of distributed priority scheduling and multi-hop 
coordination. 

5. CONCLUSIONS 

This paper addresses three issues fundamental to quality-of-service 
scheduling in ad hoc networks: distributed priority scheduling, 
priority-based medium access and multi-hop priority management. 
We introduced a distributed scheduling scheme in which the pri- 
ority index of a head-of-line packet is piggy backed onto existing 
messages so that other nodes can better assess the relative prior- 
ity of their own head-of-line packet. We devised a simple mecha- 
nism to incorporate this priority information into the IEEE 802. 1 1 
protocol and achieve most of the gains of an ideal schedule with 
only a moderate fraction of piggybacked messages overheard. We 
devised a multi-node scheduling algorithm such that downstream 
nodes can make up for excessive latencies incurred upstream via 
multi-hop coordination: given the random nature of many aspects 
of wireless ad hoc networks, we showed how coordination is an im- 
portant ingredient for targeting end-to-end QoS objectives. Finally, 
we used analytical models and simulation experiments to quantify 
the performance impact of the scheme. 
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